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. Abstract 

, In this paper we discuss the connections between a Vlasov-Fokker-Planck equation and 

^ ' an underlying microscopic particle system, and we interpret those connections in the context 

pL^ ' of the GENERIC framework (Ottinger 2005). This interpretation provides (a) a variational 

formulation for GENERIC systems, (b) insight into the origin of this variational formulation, 
and (c) an explanation of the origins of the conditions that GENERIC places on its constitutive 
elements, notably the so-called degeneracy or non-interaction conditions. This work shows 
how the general connection between large-deviation principles on one hand and gradient-flow 
' structures on the other hand extends to non-reversible particle systems. 

i^H , Key words and phrases. Vlasov-Fokker-Planck equation. Large deviation principle, GENERIC, 

' Variational principle. 

1 Introduction 

> 

'sj- ■ 1.1 Overview 

<N , 

. The framework GENERIC Ott05 provides a systematic method to derive thermodyna mically 



X 



consist ent evolution equations. It was originally introduced in the context of complex fluids jG097 



i |0G97 , and more recently has been applied to anisotropic inelastic solids [HTOSaj , to viscoplastic 



' solids jHT08b| , and thermoelastic dissipative materials |Miell| . The key ingredients of GENERIC 



are its building blocks: a Poisson operator L, a dissipative operator M, an energy functional E, 
and an entropy functional S, which are required to satisfy certain properties. Although many 
equations have been shown to have a GENERIC structure, two important aspects have not been 
addressed. 



H ■ The first one is the relationship between the GENERIC framework on one hand and large 

. - -' deviations of underlying microscopic particle systems on the other. It is well-known that many 

deterministic evolution equations can be derived as hydrodynamic limits of a stochastic particle 
system. More recently it has become clear the connection between particle systems and their up- 
scaled limits runs deeper: gradient-flow structures of the limit equations arise as characterizations 
of the large-deviation behaviour of the stochastic particle systems, thus explaining amongst other 
things the origin of the Wasserstein gradient flows jADPZllI RDPZ12[ [DrZl2l IPRlli IRenl3j . In 
this paper we generalize this relationship beyond gradient flows to an example from the class of 
GENERIC systems. 

The second aspect is a variational structure for GENERIC systems. The study of variational 
structure has important consequences for the analysis of an evolution equation. It provides general 
methods for proving well-posedness |AGS08| and characterizing large-time behaviour (e.g., [CMV03| ). 
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gives rise to natural numerical discretizations (e.g., [DMMTO]), and creates handles for the analysis 
of sing ular limits (e.g., [SS041 ISteOSl lAMP+12j V The appearance of the concepts of energy and 
entropy in the formulation of GENERIC suggests a strong variational connection, but to date this 
has not been made explicit. In this paper we exhibit such a variational structure, and as in the 
case of the gradient flows, this structure is intimately tied to the large-deviation behaviour of an 
underlying system. 

In this paper we treat some of these questions in full generality, that is, for a general, abstract 
GENERIC system. Because of this generality the treatment is necessarily formal. We illustrate 
the abstract features with a specific system, that of the Vlasov-Fokker- Planck equation, for which 
the large-deviation behaviour has been proved rigorously. This gives a specific case in which the 
impact of the abstract arguments can be recognized. We first introduce the specific example and 
then explain the GENERIC framework in detail. 



1.2 A Vlasov-Fokker-Planck equation and its generalisation 

The central example of this paper will be the following Vlasov-Fokker-Planck (VFP) equation, 

dtp = - div, + divp p{VqV + Vqip + + jBApp. (1) 

The spatial domain is R^'' with coordinates {q,p), with q and p each in R''. We use subscripts 
as in divg and Ap to indicate that the differential operators act only on those variables. The 
unknown is a time-dependent probability measure p: [0,T] — > 7'(R^''); the functions V — V{q) 
and ip = 'ip{q) are given, as are the positive constants 7, m, and 6. The convolution ip* p is defined 
by (V' * p){q) = /R2d -0(9 - q')p{q',p') dq'dp'. 

Equation ([T]) arises as the many particle limit of a collection of interacting Brownian particles 
with inertia |Bro28j . given by the following stochastic differential equation 

P (i^ 

dQJt) = -^dt, (2a) 
m 

n 

dP,{t) = -Vy(Q,(i))rfi- ^ V7/'(Q,(i) - Qj{t)) - ^P,{t)dt+y/2^dW,lt). (2b) 

Here Qi and Pi are the position and momentum of particle i = with mass m, and 

the equations describe the movement of this particle under a fixed potential V , an interaction 
potential t/i, a friction force (the drift term —"fPidt/m) and a stochastic forcing described by the 
n independent d-dimensional Wiener measures Wi. 

Both the friction force and the noise term arise from collisions with the solvent, and the 
parameter 7 in both terms characterizes the intensity of these collisions. The parameter 9 = kTa, 
where k is the Boltzmann constant and Ta is the absolute temperature, measures the mean kinetic 
energy of the solvent molecules, and therefore characterizes the magnitude of the collision noise. 
Typical applications of this system are for instance as a simplified model for chemical reactions, 
or as a model for particles interacting through Coulomb or gravitational forces. 

Equation ([l} is the many limit of the SDE also known as the hydrodynamic limit, in the 
sense that as n — >■ 00, the empirical measure 



1 " 



n — ' ' ' ' ^ " 

1=1 

converges almost surely to the solution of ((ij with appropriate initial data. Equation ([T]) has 
been extensively studied, especially in the case in which is a Coulomb or gravitational potential. 
The central difficulty in these works is the singularity of i/j. For our purposes, this issue is not 
important, and we will simply assume that "0 is bounded, thus eliminating difficulties in proving 
existence and uniqueness. 
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Although we prove a rigorous result, Theorem 12.51 the main statement of this paper is not 
Theorem 12.51 the main statement is the general structure that Theorem 12.51 strongly suggests, 
which extends much further than the example above, and which connects to the GENERIC struc- 
ture that we describe below. Because of this suggestion of a general structure, we now describe a 
generalized version of the Vlasov-Fokker-Planck equation in somewhat more abstract terms. 

Let 'H.S: 'P{R?'^) — s- R be two functionals on 7'(R^'*). Denote by gradH and grad5 the 
L^-gradicnt of % and S, otherwise known as the variational derivative. 

The following equation we call a generalized Vlasov-Fokker-Planck equation, 

dtp = div(pJV grad-H) + div(pcr(T^V grad(H + S)) , (3) 

where V and div are the gradient and divergence operators with respect to the full spatial variable 
X = {q,p) e R^'^, and J is the 2d x 2d skew symmetric block matrix 



(4) 



-Id 
Id 

where Id is the R'^'^''— identity matrix. 

The Vlasov-Fokker-Planck equation ([T|) is an example of this abstract equation, in which 

x = iq,pf eR^'', n{p)^ I i^ + V{q) + ]^{^^p){q)\ p{dqdp), (5a) 



R2d 



o- = \/7(q j J , S{p) ^ e J^^^plogpdqdp. (5b) 



d 

Other well-known equations are of the same form; the Kramers equation jKra40| is equation ([T|) 
with ip = 0, and Wasserstein gradient flows [OttOlj are of the form ^ with a = l2d and H = 0. 
As a final example, when 

a^hd, £{p)^7:[ P{i'*p), S{p)^e I plogp, 

equation ^ becomes 

dtp = div(pJVi/' * p) + OAp + div(pVV' * p)- 

This equation describes the relaxation of a point vortex towards statistical equilibrium, that arises 
in the kinetic theory of point vortices. It is closely related to the two-dimensional Navier-Stokes 
equation |Chanil KJPROSl l(]PR09l IFSS12) . 



1.3 GENERIC 

We now switch gears and introduce an abstract equation structure. Later we will connect the 
example above with this structure. 

A GENE RIC equation (General Equation for Non-Equilibrium Reversible-Irreversible Cou- 
pling Ott05 ) for an unknown z in a state space Z is a mixture of both reversible and dissipative 
dynamics: 

atz = LdE + MdS. (6) 

Here 



E, S : Z — > R are interpreted as energy and entropy functionals. 



• dE,dS are appropriate derivatives of E and S (such as either the Frechet derivative or a 
gradient with respect to some inner product); 
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• L = L(z) is for each z an antisymmetric operator satisfying the Jacobi identity 

{{Fi, F2}l, F3}l + {{F2, FsIl, Fi}l + {{F3, Fi}l, F^ji = 0, (7) 
for aU functions : Z R, 1 = 1,2,3, where the Poisson bracket {•, -Ji is defined via 

{F,G}l :=dF- LdG (8) 
(see Remark 1 1.11 for a discussion of the meaning of the 'dot' here). 

• M = M(z) is symmetric and positive semidefinite. 

Moreover, the building blocks {L, M, E, S} are required to fulfill the degeneracy conditions: for all 

LdS = 0, MdE = 0. (9) 

As a consequence of these properties, energy is conserved along a solution, and entropy is non- 
decreasing: 

dE • (LdE + MdS) = 0, 
dS • (LdE+ MdS) = dS • MdS > 0. 
A GENERIC system is then fully characterized by {Z, E, S, L, M}. 

Remark 1.1. In equation ^ we implicitly have assumed that Z is a space with a differentiable 
structure, in which time derivatives dtz and state-space derivatives dS and dE exist. In many cases 
of importance, including the main example of this paper, this is not true, and then generalizations 
are necessary; the book by Ambrosio, Gigli and Savare jAGS08| is an example of such general- 
izations in the case of gradient flows. Nonetheless, we feel that the formal differentiable way of 
writing provides the right intuition, and therefore in this formal part of the paper we maintain 
this way of writing the system. 

Even in the smooth setting, we have not made specific exactly which derivative dE and dS 
should be, and let us briefly make the situation concrete. Derivatives of the functionals E and 
S are naturally deflned as covectors, i.e. elements of the cotangent space (they are then called 
differentials) or dual space (called Frcchet derivatives). Since dtZ is an element of the tangent 
or primal space, L and M should be duality maps, mapping cotangent to tangent spaces, or 
equivalently dual to primal spaces. In this case the meaning of the dot in ^ is that of the duality 
pairing. 

In practice, however, it often is more convenient to use gradients rather than differentials: 
then the covectorial derivative is mapped to a tangent vector by some flxed duality mapping, 
associated with an inner product, often only formally. In all of the explicit calculations in this 
paper this will be the case; for instance, we already used the L^(R^'*) structure as a formal inner 
product on the space of measures 'P(R^'') to define 'gradH' in equation ([3]). In this situation L 
and M map vectors to vectors, and the dot in ([5]) is that of the formal inner product. □ 

1.4 Overview 

As described in the introduction, the aim of this paper is twofold: to connect the GENERIC 
structure with large deviations of stochastic processes, and to construct a useful variational for- 
mulation for an abstract GENERIC equation. 

In this context, the role of the VFP equation ((!]) is that of a guiding example. In brief, the 
story runs as follows: with some modification, the VFP equation can be written as a GENERIC 
system. In addition, the VFP equation has a particle background, and a recent large-deviation 



dEjzjt)) _ dz 
dt dt 

dS(z(<)) dz 
; = db • — 

dt dt 
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result allows us to connect the large deviations of the particle system with the GENERIC structure. 
Finally, this same connection shows how the VFP equation can be given a variational formulation. 

The first part of this story is told in Section[5J in which we construct a large-deviation principle 
for the SDE ^ associated with the VFP equation. Next, in Section |3] we construct a GENERIC 
structure for the VFP equation and reformulate the large-deviation rate function in this context. 
Finally, in Section |4] we deduce from the large-deviation result a variational formulation for the 
VFP equation and more generally for any GENERIC system. 

Having connected the GENERIC structure with particle systems and large deviations, in Sec- 
tion |5] we use this connection to understand the origin and interpretation of the various properties 
of GENERIC hsted in Section [Ql Section [7] is devoted to the generalization We conclude 
with some comments. 



2 Main results 1: Large deviations for the VFP equation 

For many gradient-flow systems it is now understood that the gradient-flow structure it- 
self arises from the fluctuation behaviour of an underlying stochastic process |DG89[ lADPZlll 
IADPZ12[ IDLZ12[ IPRlli IDLR121 [Rct13| . The theory of large deviations allows one to make this 
statement precise. We now apply the same ideas to the VFP equation. 

We flrst specify our conditions on the functions "0 and V. Since we are interested in presenting 
ideas rather than obtaining the most general results, we choose fairly restrictive conditions on V 
and lp to eliminate technical complications: 

V G C^(R'^) with globally bounded second derivatives, and > 0; (10a) 
lp € C^(R'') with globally bounded first and second derivatives, and ip > 0. (10b) 

In addition, we assume that the initial datum satisfies 

p° <E VCR^'^) with n{p") < oo, (10c) 

where H is defined in ([5a|) . With these assumptions, 

• Given a deterministic starting position, the stochastic differential equation ^ has strong 
solutions that arc weakly unique (see e.g. jKS91[ Chapter 3]) and non-explosive (e.g. jWuOl] ): 

• The VFP equation ([Ij is well-defined in the distributional sense and has a unique distribu- 
tional solution with initial datum p*^. We do not know of an explicit reference for this, but 
the boundcdncss of implies that standard arguments apply. For instance, existence of 
mild solutions, defined by the variation-of-constants formula, can be proved using an explicit 
fundamental solution |Cha43[ IVO90| of the differential operator 

Lp := dtp + divq (p—) - jOApp. 

V TO/ 

Uniqueness follows from an application of Gronwall's inequality. 
Given a realization {{Qi, Pi)f=i} of the particle system ([2]), we define the empirical measure 

I " 

Pn-. [o,(»)^7'(R''^), pn{t) ■■= -Y.hQ^,mt)- 

Theorem 12.51 below states that the random variable p„ satisfies a large- deviation principle as 
n — > oo. 

Definition 2.1. (A large-deviation principle |dH00l IDZ871 IFK06] ) Let 7W be a complete 
separable metric space and {pn} be a sequence of probability measures on Ai. We say that {pn} 
satisfy a large deviation principle with a rate functional /: — > [0, oo) if 
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1. For each open set A C M, hminf„_>oo ^ log7i„(A) > — ini^eA 

2. For each closed set B C M, linisup„_^oQ ^ log//„(i?) < — inix^B 

The rate functional / is said to be good if its sub-level sets {x £ M\I{x) < a} are compact for all 
a > 0. Morally, this definition describes the property that 

/i„(A) ~ exp(— riinf /) as n — >■ oo. 

We refer to [dHOOi IDZ87[ IFK06| for more information on large deviation theory. 

For the theorem below we equip Vi'R.'^'^) with the weak or narrow topology, generated by the 
duality with Cb(R^'*), so that the space C([0, T]; 7^(R^^)) consists of narrowly continuous curves 
in 7'(R2''). 

Define for ly e 7'(R^'^) the parametrized generator 



m 



"^qV + \/qij * V + 7^^] • Vp/ -f Ap/. 

. mJ 



Note that equation ([1} can be written in terms of the transpose as 

dtPt = ^p.Pt- 

For the formulation of the rate function we will also need the concept of absolute continuity 
in distributional sense. For a compact set K C R^'', the space is the set of all / G C(?°(R^'') 
with supp/ C A'; the set I? is the union of all 2?j<-, with the usual test-function topology. 

Definition 2.2. A curve [0,r] 9 1 1— > pt G 7'(R^'') is called absolutely continuous in distributional 
sense if it has the following property: for each compact K C R^'^ there exists a neighbourhood 
Uk of in T>K and an absolutely continuous function Gk ■ [0, T] — > R such that 

yO<t,<t2< T, V/ eUk: I {pt,J) - {pt.J) I < \GK{t,) - Gx(i2)|. 

The set of all such curves is denoted AC{[0,T];V{R?''-)). If p is absolutely continuous, then for 
almost all t g [0,r] the time derivative dtpt exists in I?'(R^''). The proof of this and other 
properties of this concept can be found in |DG871 Section 4] . 

Finally, wc define the norm that will measure the magnitude of fluctuations: 
Definition 2.3. Fix p e 'P(R^'*). For any distribution T G V'{R^'^) define 

\\T\Wp:= sup 2{TJ)-[ \Vpf\'dp. (11) 



Define Ly{p) as the completion of {Vp/ : / e C^(R^'^)} with respect to the norm 

!|-Ilp:=/ \-\'dp. 

Note that, depending on p, \\-\\p may be only a seminorm and not a norm; but since the completion 
identifies elements that have zero distance in this seminorm, L'^{p) is a well-defined Hilbert space. 
Its elements are equivalence classes of measurable functions that are p-a.e. equal. Also note that 
whenever 'H{p) < 00, the function {q,p) 1— >■ p belongs to L^{p). 

The dual norm || • ||-i,p has an explicit representation: 
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Lemma 2.4. 



ml 




ivp{ph) with h G L'^{p), 



Proof. Results of this type are common; this argument is adapted from |DG87j . 

Since there is a one-to-one correspondence between / G C^(R^'') and Vp/ £ L := {Vp/ : 
/ e Cj?°(R^'')}, T can be considered to be a hnear functional on L. If |jT||-i,p < oo, we can 
replace / by A/ and optimize with respect to A e R in (fTT|) . We then find that 

l(r,/)|<||r||-i,p||Vp/ii,. 

Therefore T is bounded with respect to the Ly (p)-norm; it can be uniquely extended to a bounded 
linear functional on the whole of and Riesz' representation theorem implies the assertion 

of the Lemma. □ 



Wc can now state the large-deviation principle. 

Theorem 2.5. Assume that the initial data {Qi{0), Pi{0)) , i = are deterministic and 

chosen such that Pn{0) for some p^ £ V(R^'^). Then the empirical process {pn} satisfies a 

large- deviation principle in the space C([0,T],7'(R^'^)), with good rate function 



Hp) 



I^PtPt-^>t\\-i,pJ* ^fp&AC{[0,T];ViR^'')) with pU=o ^ 
[ +00 otherwise. 



(12) 



The rate function I can also be written as 

Hp) 



I \ht?dptdt ifdtPt^A;^pt~divp{ptht),forheL^O,T;Llipt)), 

[ +00 otherwise. 

(13) 

Proof. Setting x ~ {q,p) and b[x, v) ^ {p/m, —S/V{q) — (VV' * '^){q) — ip/'m) for v G 7'(R^'*), the 
system ([2]) can be written as system of weakly interacting diffusions 



dX,{t) = b{X,{t),Pn{t)) dt + <jdW,{t), 



(14) 



where Wi are d-dimensional standard Wiener processes and for the length of this proof, a is the 
2d X d matrix 

'0~ 



Id 



Theorem 3.1 and Remark 3.2 of jBDF12| implies that /?„ satisfies a large-deviation principle with 
rate function 



I{p) := inf E 



\Ut\^dt 



where the infimum is taken over all processes {X, U, W) taking values in R x R x R that solve 



dXt = b{Xt,pt) dt + crUt dt + adWt, 

is a standard d-dimensional Wiener process, 
lawXt = pt for all t. 



(15a) 
(15b) 
(15c) 
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For each such triple, for any / € C^(R x R ) the process 



Mt ft[Xt) - /o(Xo) - / [{ds + Ap, + {aUs) ■ V)/,] (X,) ds 

Jq 

is a martingale, and therefore EAIt = Ei\/o = for every t > 0. 

We now show ([12]) by showing that 1 = 1. Define for any p € C{[0,T];V{B?'^)) and / S 
C;f (Rx R^''), 



J{p,f)-= I frdpT- [ fodpa- [ [ [ids+ApJf,]dpsds--,e [ [ |Vp/tpdp, 

jR2rf jR2d Jo JR2'i Jo JR2rf 

It is well known (see e.g. |DG87[ Lemma 4.8]) that 

Iip)= sup J(p,/). 

/eC~(RxR2rf) 

We have for any / e C^(R x R^"*) and for any solution (X, U, M^) of (US), 
Using EMt = we rewrite this as 



dt. 









= E 



















+ E 








2 70 



/t(Xt) -/o(^o)- r[(a,+ApJ/,](X,)ds-i r \\/pf,{X,)\^ds 
Jo ^ Jo 



\Ut~VpMXt)\''dt 



1 

2 7o 



(16) 



Therefore 



I{p) = inf E 



WA'dt 



>supJ(p,/) = /(p). 
/ 



To prove the converse inequality, assume without loss of generality that I{p) < oo. Using a 
reasoning similar to the proof of Lemma [2^ we find that there exists a.n h £ L^{0, T; L'^{pt)) such 
that 

dtpt — A^p^pt = — y''2j6 divp pfht in the sense of distributions. (17) 

Here the space L^{0, T; L'^{pt)) is the Hilbert space obtained by closing C^(Rx R^'') with respect 
to the (semi-)norm 



II/IIL 



\fix,t)\^pt{x)dt. (18) 

/O JR2d 

We now construct a specific solution of ([T5|) . Let {X, W) be a solution of (|15ap with U = and 
lawXo = p°; let P be the law of {X,W) on C{[0,T];R^'^) x C([0, T]; R''). Since |j/i||p,T < oo, the 
process 



Nf.^a h,iX,)dWs 
Jo 

is a P-square integrable continuous martingale with quadratic variation {N)t = 2"f9t. 
Define P,, as the modified law on C([0, T]; R^'') x C([0,r];R'') given by 



Ph := exp[NT ' ^{N)t] P 
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By the Girsanov theorem (e.g. jIW81[ Section IV. 4]) Ph is the law of the unique solution {X, W) 
of equation (jl5ap with Ut = ht{Xt), and since equation ([TT)) is the corresponding Fokker-Planck 
equation, it follows that the law of Xt is equal to pt- Therefore {X,ho X, W) is a solution of ([T5|) . 
Using (fTB|) for this solution, we find for all / that 



\htiXt)~\/pftiXt)\''dt 



/ \ht{Xt)-WpftiXt)\''dt 
Jo 

476* Jo JR2d 



Since L^(0, T; iy(pt)) is the closure of under the norm (fT8)) . 

/eC~(RxR2i)Jo JR2d 

Hence /(p) < /(p) and this concludes the proof of (HD). The form as in (fT5|) of / then follows 
from (ini) and Lemma [231 □ 



Remark 2.6. The structure of the large-deviation result of Theorem 12.51 refiects a number of 
properties of the stochastic particle system To start with, the rate function is only finite if dtp— 
p only has a perturbation in the p-direction, not in the g-direction; this refiects the fact in (p|) 
that the noise is confined to the P-equation. In addition, the perturbation can only be in divergence 
form; this reflects the deterministic conservation of particles. Finally, the fiux is of the form ph 
where h is in the closure L'^(p) of p-gradients; this property is also seen in the characterization of 
absolutely continuous curves in the Wasserstein metric |AGS08[ Theorem 8.3.2]. □ 

Remark 2.7. There is a large literature on large-deviation principles for stochastic particle sys- 
tems; here we just mention a few results. Dawson and Gartner jDG87| prove a large-deviations 
result for systems of interacting particles with non-degenerate diffusion, i.e., for nonsingular mo- 
bilities a with range R^''. Cattiaux and Leonard |CL94. ,CL95aj generalize the method of Dawson 
and Gartner to singular mobilities, but for independent particles. In a separate paper |CL95b| . 
Cattiaux and Leonard also discuss the identification question treated in the proof of Theorem 12. 51 
in more generality. Fischer |Fisl2| also proves identification results on related systems. 

In the proof above we used the large-deviation result by Budhiraja et al. |BDF12| above to 
obtain the large-deviation principle itself and a first characterization of the rate functional. The 
methods by which we identified / with / arc standard, but we did not find a theorem that suited 
our needs, and therefore we gave a separate proof. □ 

For the sequel it will be useful to have a regularity result on the Hamiltonian T-L (see ((5a|l ) 
associated with those curves p for which I{p) is finite: 

Lemma 2.8. // I{p) < 00 and 'H(po) < 00, then the function t 1—^ T~L{pt) is an element of 
iyi-2(0,T), and J^,,p^dpt e L°°(0,T). 

Proof. By (jlOp . H{p) bounds the integral j /m? dp from above. Using the characterization of 
Remark [131 we formally calculate that 



dt'H{pt) = -J I -^dpt 



m 



m 



ht dpt 



(19) 



< 1 ^dpt+j —dpt + — \ht\ dpt 

m J TO^ J 47 

lOd 1 f 2 

m 47 7 
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This calculation can be made rigorous in its time-integrated form by approximating /m? + V(q) 
by a sequence of smooth functions /„ £ Cj?°(R^''), and using /„ in the distributional form of the 
equation dtpt = ^f^^Pt ~ divp(pt/ij). Continuing with the proof, it follows that 

sup n{pt)<n{po) + —T + ^ [ [\ht\^dpt = n{po) + —T + ei{p)<^, 

and consequently J dpt is also uniformly bounded. We conclude by remarking that the right- 
hand side of p^ . as a function of time t, is an element of L^(0,T). □ 

Remark 2.9. Note that a solution p of ^ satisfies I{p) — 0, and therefore Lemma 12.81 also 
applies to solutions of ([T]). □ 



3 Main results 2: The VFP equation and the large devia- 
tions in GENERIC form 

In this section we reformulate both the VFP equation and the large-deviation rate functional 
of the previous section in terms of the GENERIC structure. It will become apparent that the 
large-deviation behaviour respects the GENERIC structure, in the sense that the rate function 
for this system can be formulated in an abstract form, using only the GENERIC building blocks. 
This will suggest in Section U] a variational formulation for a very general GENERIC system. 



3.1 Making the VFP equation conserve energy 



As it stands, the VFP equation ([IJ does not satisfy the conditions of GENERIC, since there 
is no conserved functional E. The reason for this is physical: the SDE ([2]) models a system of 
particles in interaction with a heat bath, and this interaction causes fluctuations of the natural 
energy (the Hamiltonian) of the particle system, 



Hn{Ql 



: Qn7 Pi •}■•••} Pn ) 



■E 



[2rn 



1 

2^ 



J2 i^iQ^-Qj)- 



(20) 



Indeed, combining ([2]) with Ito's lemma the derivative of the expression above is 



n 

--E 

n ^ 



^P? dt 



"fOd 



dt 



/2^ 



P,.dW, 



which has no reason to vanish. There is a simple remedy for this: we add a single scalar unknown Cr, 
and define its evolution by the negative of the above, leading to the extended particle system 



Pt 

dQi — — dt, 
m 



dP, = - Vy (Q,) dt-y V^(Q, -Qj)- ^P^ dt + dW, 



de 



n 



^Pfdt- 



-fOd 



dt 



P,.dW, 



(21a) 
(21b) 

(21c) 



with which _ff„ + e„ becomes dcterministically constant. Note that e„ can be interpreted as the 
energy of the heat bath; the flow of energy between the particle system and the heat bath is 
described by the flow of energy between Hn and e„. 

Exactly the same arguments apply to the VFP equation ([1]). At this level the analogue of 
the Hamiltonian iJ„ is the functional % defined in ([5a|. and indeed H is not constant along a 
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solution, as can be directly verified. We mirror the arguments above and add a new variable e, 
depending only on time, so that the solution space becomes (p, e) G V(R'^'^) x R. The full system 
is now defined by the VFP equation ([T]) plus the equation de/dt = —{d/dt)H{p), that guarantees 
that 'H(p) + e is conserved. When writing this equation in full, it becomes 

dtp = - divq(^p^^ +divpp(v,y + VgV^P + T^) +lOApp, (22a) 

^e^jf P^pidqdp)-:^. (22b) 
dt jRSd m m 

We stress that this system is coupled only in one direction: the second equation is slaved to 
the first one. Note that equation (j22bp is well-defined: if 'H(/9o) < oo, then by Lemma [2.81 and 
Remark \'2.9\ T-lJpt) is bounded for all t; therefore / p^dpt is finite for all t. 

By this simple mechanism a non-conserving system can be made conserving. Although math- 
ematically this is no more than a trick, for this system it has physical meaning, as we argued 
above: the additional variable keeps track of the movement of energy between the particle system 
and the heat bath. We next show that the remaining conditions of GENERIC can also be verified. 

3.2 The VFP equation as a GENERIC system 

With the extension of the previous section, the VFP equation is formally a GENERIC system 
with the following building blocks: 

Z = 7'2(R2^)xR, E{p,e)=n{p) + e, I = l{p,e) ^ (^p^" ^ 

(23) 

z=(p,e), S(p,e)=5(p)+e, M = M{p,e) = j (^^^^^^ 

where the operators defining L and M are given, upon applying them to a vector (^,r) at (p, e), 

by 

/ p 

Lpp^ = div pJV^, Mpp^= - divp pVp^, Mper = r divp \^p— 

,2 



'epS 



f p f P 

'A = - I — ■ ^p£,p{dqdp) MeeT = r / — p{dqdp). 
The space 'P2(R^'^) is the subset of ■p(R^'') with bounded second p- moments: 

P2(R"') := |p e P(R''') : / p^p{dpdq) <oo]. 
We equip 7'2(R^'') with the same weak topology as 7'(R^'^). Finally, the entropy S is defined as 
S{p) ~9 / f {x) log f (x) dx whenever p has Lebesguc density /. 

jR2<i 

With these definitions, equation ((T)) can be written as 

dtzt = L(zt)gradE(zt) + M(zt) gradS(zt), (24) 

where the gradient operators are to be interpreted as i^-gradients. At this stage, however, this 
equation is formal, since the sense in which this equation holds has not been specified. Rather 
than going into detail here, we defer this discussion to after the introduction of the variational 
structure in Section H) 
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The operators L and M can readily be seen to be antisymmetric and symmetric (with respect 
to the L^-inner-product, since we use L^-gradients as derivatives); for instance, in the case of L, 
we have for any vectors (^i, ri) and (^2, 1^2) at (p, e) by partial integration that 

((6,ri),L(p,e)(6,r2)) = (6,Lpp(p)e2)= / 6divpJV6 = -/ V6 • J^Va P, 

which is antisymmetric since J is antisymmetric (see (|4])). The verification of the symmetry of M 
is similar; the verification of the Jacobi identity ([7]) is a tedious but elementary calculation, which 
hinges on the fact that J is constant and antisymmetric. Finally, the verification of the degeneracy 
conditions ^ is again straightforward. 



3.3 Large deviations for the VFP equation in GENERIC form 



We now reformulate the large-deviations rate functional of Theorem 12.51 in terms of the 
GENERIC building blocks above, and therefore in terms of the extended unknown z = (p, e) € Z. 
To do this, we also generalize the concepts of absolute continuity and introduce the appropriate 
norms. 

Definition 3.1. The function [0,T] 3 t 1-^ z{t) = {p{t),e{t)) e Z is absolutely continuous if 
AC([0,T];-P2(R^'')) and e € AC([0, T]; R). 

Again, if z is absolutely continous, then dtz exists for almost all t as an element of X''(R2'*) x R. 

The 'matrix' M generates a natural pair of semi-inner-products and seminorms. 

Definition 3.2. Fix z = {p,e) £ Z. The seminorms || • ||m(z) and || • ||m(z)-i are defined as follows. 
For (^r) e C^(K^'^) x R, 



M(z) •= 7 

= 7 



R2d 



R2d 



m 



dp = 7 



m 



dx 



For (r,s) e V'CR^'^) X R, 



C^' *)IIm(z)-i 



sup 2(r,0+2sr-|l(e,r)f^(,). 
4ec~(R^'') 

r6R 



(25) 



The inner products (■, ■)m and (■,-)m-i arc then defined through the expression 4(a, &) = \\a + 
b\\^-\\a-bf. 

As in the case of L'^{p), the M-seminorm is degenerate: there exist p, and r for which it 
vanishes. Let J^m be the set of equivalence classes of elements of C^(R^'^) x R with zero distance 
in this norm. On J^m, the M-seminorm is a norm, and we define Hm as the completion of 
with respect to this norm. Note that Hm can be identified with the space L^{p), as follows. On 
one hand, if {rjn, s„) is a Cauchy sequence in J^, then 



|(?7n:S«) - (??«', Sn')|L = \/7 Vp(7?„ - !]„') - (s„ - S„' ) — 



as n, ri 00, 



so that Vp7/„ — Snp/m is a Cauchy sequence in iy(p) and thus converges to some h G Ly(p); vice 
versa, for each h e L^{p) by definition there exists a sequence rjn G such that Vp7/„ — > h in 
Ly{p), and therefore {rjn, 0) is a Cauchy sequence in corresponding to h. 

Since the M-seminorm is degenerate, the M~^-seminorm is singular. Indeed, Lemma 
implies the following 



13 



Lemma 3.3. Assume that J^2dP^ dp < oo. The 



„ i — f \h\^ dp ifT=— div„ ph with h € L%(p) and s = — f 

I +00 otherwise. 



— ■ h dp, 



Proof. As in the case of Lemma 12.41 li (7~, s)|| m(z)~i < 00 implies that {T,s) is a hnear functional 
on X R, and by the assumption J p'^ dp < 00 it is bounded with respect to the M-seminorm. 
Because of the identification with L^{p) we can consider it as a bounded linear functional on 
By the Riesz representation theorem there exists an element h € Li^ip) such that for all 

^ and r 

{T,0+rs^ [ h{Vpi-r^\dp= I h-\/p^dp~r[ h-^dp. 

jR,2d V TO/ J^2d jR,2d TO 

From this identity the claim follows. □ 



The rate function of Theorem 12.51 now has a reformulation in terms of the objects that we 
have just defined. 

Lemma 3.4. The rate function I of Theorem \2.5\ can he written in terms of z as 
J -^Wdat - L(zt)gradE(zt) - M(zt) gradS(zt)| 



1 2 , 

lM(zf)-i ' 



•m = 



ifz= ip,e) e AC([0,r]; Z) and pt^o = P°, 
+00 otherwise, 



(26) 



in the sense that 

j{{P,e)) 



I{p) provided 1 1— > 'H(pf ) + is constant 

+CX) otherwise. 



Proof. First assume that I{p) < 00. By (fT2)) and Lemma [2^ we have 

dtpt - ^p^Pt = - diY ptht, 
where h € L'^{Q,T; L'^ipt)). Define e by 

f ^6d f p 

eo := and dtCt = j — pt{dqdp) h / —htpt{dqdp). 

Jii2d rw^ m J-R.2d TO 

By Lemma the function t^j p^ dpt is in L°°{0,T), and since h G L^(0, T; iy (pt)) the last 
term is in L^{0,T); therefore e is well-defined, and an element of j4C([0, T]; R). By construction 
the function t 1— > 'H(pt) + is constant. Upon setting z := (p, e), an explicit calculation shows 
that /(p) and J(z) are both equal to {Aj9)~^ J-^2d l^tP dptdt. 

A similar argument starts by assuming J(z) < 00 for z = (p, e) and showing that /(p) and 
J(z) are again equal. □ 



Remark 3.5. Note how the condition of constant energy H + e is contained in ([^^ through the 
defintion of the seminorm || • ||m-i- D 
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4 Main results 3: A variational formulation for GENERIC 
systems 

The functional J in has the interesting property that it only depends on the GENERIC 
building blocks, and therefore makes sense, at least formally, for an arbitrary GENERIC sys- 
tem. We now explore the consequences of this observation for general GENERIC systems. The 
discussion in this section is therefore necessarily formal. 

First, we note that the functional J can be written in a different way by using one of the 
degeneracy conditions As above, we associate a formal inner product with M and M^^ by 



(a, &)M:=a-M6 and {a,b) 



1-1; 



(See Remark 11.11 for a discussion of the dot in these expressions). Then the antisymmetry of L 
and the first degeneracy condition in ^ imply that 

(Lgrad E, M gradS)|^_i = Lgrad E • gradS = — grad E • LgradS = 0. 

Therefore 

|2 ,, , , ^||2 , , ^l|2 



l^tz- LgradE- MgradS||^_i = H^tz - Lgrad E||^_i + |1M gTadS||^_i + 2(9*2, M grad S) 



SO that 



1 1 2 1 1 2 

\dtz - LgradE||^_i + || gradS||^ + 25*2 • gradS, 



lows: 



2ej{z) - S(z(T)) - S(z(0)) + i ^ [lia^z - LgradEf^_, + || gradS||y dt. (27) 
This discussion suggests a general variational formulation for any GENERIC system, as fol- 

Variational formulation of a GENERIC system: Given a GENERIC system 
{Z, E,S, L, M}, define J as in (gT]). A function z: [0,T] Z is a solution of the 
GENERIC equation dH) iff J(z) = 0. 

In full generality, this characterization is formal; no details about the functional setting are stated. 
In the example of the VFP equation, however, this formulation is exact, as described by Lemma [3.4l 

Indeed, let us now come back to the question in which sense the VFP equation satisfies the 
GENERIC equation ((M]) . The discussion above suggests that this variational formulation could 
be a natural solution concept. Indeed, for any z = (p, e) G AC([0,T];Z) with finite S(2(0)) each 
of the terms in ([27)) makes sense as an element of (— oo, oo]: 

• S(z(T)) G (—00,00] by definition; 

• The assumption that z G AC([0,T]; Z) implies that for almost all i, dtp is a distribution on 
R^'' and dte exists in R; 

• Under reasonable assumptions on V and -0, L grad E = — div,, pp/m + divp p\y qV + V qi) * p\ 
is well-defined in the sense of distributions; 

• Therefore the scminorm ||9fZ— LgradE||?._i is well-defined in [0,oo]; 



The seminorm || • j|^ can be assumed well-defined in [0,oo] for any argument, by extending 
it by +00 outside of Hu ■ 



For the VFP equation there are several other solution concepts that are natural for different 
reasons and have various advantages; examples are distributional solutions and solutions in the 
sense of semigroups (since the first and last terms on the right-hand side of ([T]) form a hypoelliptic 
operator with a smooth and strictly positive fundamental solution). The relevance of this discus- 
sion therefore lies not so much in the specific case of the VFP equation, but more in the potential 
application to general GENERIC systems. 
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Remark 4.1. Gradient flows are GENERIC systems with E = 0. For this class of systems, 
this variational formulation is well known and has been put to good use. For instance, Sandier 
and Serfarty j^S'SOl] (sec also e.g. |Ser09[ ISteOSi [LeOHl lAMP+12] ) showed how the variational 
form can be used to pass to limits in parameters in the equation. We expect something similar 
might be possible for these GENERIC variational formulations, and will return to this in a future 
publication. □ 



5 Synthesis 

Let us recapitulate what we have just seen. 

• The VFP equation has a variational formulation of the type ' J(z) > 0, and J(z) = iff z is 
a solution'; 

• This variational formulation, the functional J, is identical to the large-deviation rate func- 
tional for the stochastic particle system ([5]) for the case of fixed energy; 

• The equation and the variational formulation can both be written in terms of only the 
GENERIC building blocks; 

• This suggests a variational formulation for an arbitrary GENERIC system. 

In the remainder of this paper we discuss a number of consequences. In Section |6] we use 
the connection between the VFP equation, large deviations, and the GENERIC structure to shed 
some light on the properties of GENERIC as formulated in Section 11.31 Section [7] is devoted to 
the generalization mentioned in Section [1.2l 



6 Interpretation of the GENERIC properties 

The GENERIC structure of the VFP equation, introduced in Section 13.21 does raise some 
questions. Why are these bulding blocks the 'right' ones, from a philosophical, or modelling point 
of view? Is it clear why E and S should be what they are defined to be in Is it clear why L 

and M are what they are? Why they do indeed satisfy the various conditions described above? 

In addition, the origin of the GENERIC properties themselves, as described in Section [T751 is 
somewhat obscure. Why should 'every' thermodynamic system satisfy these properties? We now 
show how the connection with large deviations of the underlying particle system gives us some 
answers to these questions. 

The reversible operator L and the Hamiltonian %. First consider the simpler case when 
"0 = 0. Then the only non-zero component of the operator L, which is Lpp = — divpJV, is the 
Liouville operator for the Hamiltonian flow on R^'' generated by the symplectic matrix J and the 
Hamiltonian H{q,p) = /2m + V{q). Indeed, x{t) = {q{t),p{t)) solves the Hamiltonian equation 

= -JVi/(x) 

if and only if p{t) := S^i^^.-^ solves 

dtp - div{p3VH) = 0. 

Therefore L is the natural embedding of the symplectic geometry of J in R^'' into the space of 
measures 7'(R^''); and when ijj = 0, 'H{5x) = H{x), and therefore V. similarly is the natural 
embedding of the R^'^-space Hamiltonian H into the space of measures. The anti-symmetry and 
Jacobi identity properties of L follow directly from that of the matrix J. 
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When -0 is non-zero, a similar interpretation of H is possible, since with the notation of (j20[) 
we have 

1 " 

'H{t]„{xi,...,x„)) = Hnixi,...,x„), where ?7„(a;i, . . . , a;„) := - ^ 4^. 



} 2nd 



Similarly, L can be interpreted as the embedding into 7^(R ) of the Hamiltonian flow on R 
generated by a symplectic matrix J„ consisting of n copies of J. 

The entropy functional S. The functional S in (|23p is defined as e + S{p) = e — 9 J plogpdx. 
The second term in this sum is the usual entropy of p, multiplied by temperature 9. Its form arises 
from the loss of information in the mapping rjn defined above. We explain it now for the case 
of finite state S = {1, • • • ,r}; the general case can be handled using the characterization of the 
relative entropy as a supremum over finite partitions [DE97[ Lemma 1.4.3]. Let Xi, ■ ■ ■ ,X„ be 
independent identically distributed 5-valued random variables with common law /x on a probability 
space (ri,S],P). Define the (random) empirical measure 



1 " 

rj — ^ 



There is a loss of information in going from Xi, -- ,X„ to the empirical measure Ln(a;) 
characterizes the observed frequencies of {1, • • • , r} among Xi{uj), • • • , X„(a;), but docs not tell 
us exactly what values they take. The degree of degeneracy^ the number of possible ways that 
Xi{u;), ■ ■ ■ ,Xn{u!) can be such that L„(a;) is equal to a given p = (piY^^i ~ • • • , ■^), where 



(/ci, • • • ,kr) e N'^, X^Li h = n, is ^ 



fci {■■■k^ ! 



We have 



Prob(L„ = p) 



ki\---kr\ 



i=l 



where pi = p{i) for i = 1, • • • , r. Hence 



1 1 / 

- log Prob(i„ = p) = - log n ! - /ci ! + /cj log /ij 

\ i=i i=i 



Using Stirling's formula in the form 

log ml = m log m — m + o{m) as m — )- cx), 

we find 



- log P(L„ = p) « - 
n n 



n log n - n - '^{h log h - fei) + E ^'^^ 



i=l 



i=l 



log n — — log ki + — log Pi (since Y^ ki = n) 

2—1 2—1 2—1 

Pt (log ?i - log ki + log (since Pi ^ — and ^ = 1) 



2 = 1 



2 = 1 



E ^» (~ P2 + log A«2) = - E ■ 



Retracing the steps in this computation we see that the term X]I=i Pi^'^ZPi originates from the 
degree of degeneracy ".'^ , . 
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The degeneracy condition LgradS = 0. In the case of the VFP equation, this property holds 
true for any functional which depends locally on p, i.e., any functional of the form 



F(p,e) = e + J f{p)dx. 



The functional S indeed has this form with f{p) = plogp. Therefore the degeneracy LgradS = 
holds exactly because the entropy is a local functional — and this locality is closely connected to 
the fact that the entropy characterizes the loss of information encountered when taking a limit 
and representing the system in terms of (limits of) empirical measures, as described above. 

The irreversible operator M and its properties. To understand the operator M we use an 
argument that we learned from Alexander Mielke. We transform the co-ordinates z = [p, e) to 
z = (p, e), where 



P ■= P, 



gradH dp. 



Then the new variable z again solves a GE NERIC equation, with new building blocks L, M, 
and S. Using the change-of- variable formula jCOQ?] . the operator M is given by 



M 



a(z) 
9(z) 



M 



8(1) 



where 



d{2 



'dp dp\ 
dp de \ 



5W \fp 



d{z) 



id 
/□gradH id 



(28) 



is the transformation matrix. This formula should be read as operator composition; we write id 
for the identity operator, both for functions on R^'' and for elements of R, and we use the notation 



□ grad T-L for the operator \ £, grad Ti. 



Hence 
M(?) 



id ( 
J □ grad % ii 

id ( 
J □ grad % ii 

- divp(pVpn) 




— divp(pVpn) □ divp(Vp gradH) 

/Vpgrad-H • VpDdp □ / |Vp gradHp dp 

-divp(pVpn) 

/ VpgradH • VpDdp 



□ gradH 
id 



These remarks now enable us to comment on the form of M. First, the transformation to a 
different set of variables has the effect of 'cleaning up' the operator M: in the new variables z, 
the operator only acts on the p variable. Also, The operator M is clearly symmetric and positive 
semi-definite. The same properties for M then follow as a consequence of (|28p . 

The operator — diVp(pVpn) that appears in M is a familiar figure. It also appears in the char- 
acterization of Wasserstein gradient flows [ADPZ12] , and originates in the fluctuation behaviour 
of the Brownian noise in those systems — as is the case in Theorem 12.51 In the SDE ([2]), however, 
the noise only appears in the P- variable, and as a consequence the operator — divp(pVpn) also 
only operates on the p- variables. The symmetry of this operator is a consequence of Ito's formula: 
in this formula for the stochastic evolution of functions f{Xt) of a stochastic variable Xt, the 
second derivative d^ f appears, and this second derivative gives rise to the second-order derivative 
in — diVp(pVpn). The symmetry of this expression therefore has the same origin as the symmetry 
of second-derivative matrices of functions. 
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In the new variables, the degeneracy condition M grad E is natural; indeed, E(z) = £((/?, e)) = 
e. Therefore gradE = (0, 1), and the degeneracy condition coincides with the property that only 
Mpp is non-zero. 

To conclude, the connection between large deviations and the GENERIC structure in the 
case of the VFP equation allows us to understand and explain where the various properties of the 
GENERIC formalism come from: 

• The antisymmetry and the Jacobi identity of L follow from the same properties of the 
underlying Hamiltonian system; 

• The symmetry of M follows from the symmetry of second derivatives, as they appear in Ito's 
formula; 

• The energy E is (an extended version of) the Hamiltonian of the underlying system, after 
embedding into the space of measures; 

• The entropy S characterizes the loss of information upon passing to empirical measures, in 
the sense of large deviations; 

• The degeneracy condition L grad S = arises from the fact that S is a local functional; 

• The degeneracy condition M grad E = arises as a consequence of energy conservation. 



7 GENERIC formulation of the generalized VFP equation 
and its variational structure 

Once the variational structure of the VFP equation ((T)) has been recognized, a natural gener- 
alization of the VFP equation presents itself. By replacing the various terms by their equivalents 
in terms of S and one arrives at equation ([3]). In this section, we show that this equation, after 
extension, also is a GENERIC system for abitrary S and H, and we compute the corresponding 
functional J explicitly. This section is necessarily formal. 

By computing the derivative d'H{pt) for a solution p of ([3]) we construct the extended version 
of ©: 

dtp = div(pJV grad-H) + div(2?(/9) V grad(-H + S)) , (29a) 
d f 

— e = / Vgrad-H-2?(p) • VgradCH+5). (29b) 
at J^2d 

Here ^{p) := paa^ . The corresponding GENERIC building blocks are 



7'2(R''')xR, £{p,e)^H{p) + e, L = L(p, e) = (^^^^ ° 

(p,e), S(p,e)=5(p)-Ke, M = M(p, e) = 7 



(30) 



where the components of L and M are given by 

Lppe = divpJVe, Uppi = -AiY{V{p)\/C), Mper = rdiv(l?(p)VgradH), 

oi = - I ■V{p)-Vgi:&dn Meer = r [ (V grad H)^ • I?(p) • V grad 



'ep<. 



Most of the GENERIC properties of Section [T31 follow immediately from this setup, such as 
the antisymmetry and symmetry of L and M, the Jacobi identity, the positive semidefiniteness of M. 
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The degeneracy condition M grad E = can be checked exphcitly, but it can also be understood 
in the same way as in Section |6l by first transforming the system to a new set of variables. 

Finally, the degeneracy condition L grad S requires a specific assumption, as we already en- 
countered above: 

Lemma 7.1. //S(p) ~ J fip) for some function f, then the system (j29p is a GENERIC system 
with the building blocks (|30p . 

The proof consists of simple verification. 

By following the same arguments as in Section [21 we find a variational formulation of exactly 
the same type: a curve z <E AC{[0,T]; Z) is a variational solution if J(z) = 0, where J is defined 
by (P?]) with building blocks ([5n| . We have the following characterization: 

Lemma 7.2. For equation (j29p the functional J, defined in (|27p . can be characterized as follows: 
If 

Jt\e)^ VFPg(p, e) + ^^^^^^ ^ g^^^ ^ J , 
then ^ 

J(p,e) = i/ / Vri^ -Vip) -Vr^dxdt. 

Here VFPg(/9, e) is the right-hand side of (j29p . 
The proof follows the same lines as as Lemmas 13.31 and 13.41 
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